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Abstract 

We investigate through a mis- 
sion scheduling problem how a neu- 
ral network can work compared to a 
hybrid >ysiom based on oparatiun 
research and artificial intelligence 
approach. Then we present a discus- 
sion to demonstrate the characte- 
ristic features of each one. 
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1 Introduction 

Problems that have combinatorial 
complexity are generally said NP- 
complete problems (meaning that 
there are no polynomial algorithm 
for finding optimal solutions). About 
solving combinatorial optimization 
problems, standard operation re- 
search methods are effective for 
little problems but they often failed 
when more complex problems invol- 
ving many variables and constraints 
are to be solved. 

Whenever we cannot use stan- 
dard methods, more suitable "hybrid" 
systems merging operation research 
and artificial intelligence tech- 
niques but very domain dependant 
and less restricting, work v/ith spe- 
cific heuristics and offer non opti- 
mal but very satisfying solutions. 

A more general "hybrid" system, 
OSCAR, based on an automatic in- 
telligent reasoning has been built in 
[9] for the mission scheduling pro- 
blem, using a general assignment al- 
gorithm designed to work with a 
variety of heuristics and rules to 
make choices and define the reaso- 
ning strategies. 

NP-complete problems also have 
been shown to be solved by a neural 
network approach if they can be 
formulated as optimization pro- 
blems [3]. Indeed many researchers 
have shown that neural networks are 
satisfying constraint systems and 
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that we are able to design neural 
networks giving very good solutions 
for operation research problems. 

A number of papers have been yield 
which compare different neural 
network techniques for solving op- 
timization problems [5,6,7]. 

Whenever it is known [3] that 
computational power and speed of 
collective analog networks of neu- 
rons in rapidly solving optimization 
problems has been demonstrated, 
we ask what are really interests of 
a neural approach compared to other 
approaches through a specific 
assignment problem. 

When OSCAR works with local 
measures, we propose to compare, 
for the same assignment problem, 
such a system to an optimization 
method based on neural networks 
involving a global measure. 

After briefly presenting the 
assignment problem, we give the 
principle of the general assignment 
algorithm then the neural network 
approach. Then we discuss about 
properties of both approaches giving 
our topics about weakness and 
strength of each one. 


2 The scheduling problem 
Interests 

A spacecraft scheduling is a 
difficult problem because of a large 
number of different and interacting 
constraints, uncertainty and often 
situation-dependant optimization 


criteria which make the search 
process computationaly complex. 

The mission scheduling problem 
consists of finding both a set of 
resources and a temporal position 
for each elementary lower-level 
activity. Our interest deals with 
three points: 

- Temporal relative and absolute 
constraints 

- Activities which are elementary 
action to be performed on the 
spacecraft or on the ground 
requiring one resource-group to be 
chosen among various possible 
resource-groups. 

- Pointwise unsharable resources 
defined in [9] as resources involving 
both the assignment and scheduling 
problems. Such a resource is for 
example a camera and the camera 
assignment problem has to be the 
following. 

The camera "resource" 

An heliosynchronous spacecraft 
payload consists of cameras with 
tilting capabilities. Therefore, its 
workload consists of activities Aj 
which are processed by taking rj 
pictures of a given area from a 
possible set of specified orbits. The 
area is defined on the orbits by its 
beginning (bj) and ending (ej) 
latitudes and has a given width. 
Mirrors allow to take pictures of the 
landbelt not only just below the 
satellite but also above several 
landbelts beside the central band. 
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Since weather conditions can alter 
the quality of a picture, rj pictures 
are required to satisfy an activity 
i.e. get a good picture of all the 
expected areas. 

Let rj the required number of 
processings of activity Aj. The 
workload is built dynamically and 
thus the assignment of the 
activities must be updated after 
each request. The sequence of orbits 
is given and cannot be changed in 
any way. Therefore at a given time t, 
the following orbits Oi...On are 
described with the activities which 
are assigned to. 


camera 



Why this is a "conflict-solving" 
system is that in this activity 
assignment problem we have to 
make choices that is to find a 
resource (an orbit interval) among 
several possible unsharable re- 
sources respecting constraints. 


3 A "hybrid" system: OSCAR 

OSCAR merges operation re- 
search and artificial intelligence 
methods for solving a large class of 
spatial missions assignment pro- 
blems (more precisely scheduling 
problems). 

The set of problems OSCAR is 
able to solve is the following : 

given a set of activities, the goal is 
to find both a set of resources and a 
temporal position for each elemen- 
tary activity to process. 

Let us define: 

- An activity 

cannot be split and has to be 
assigned on the same resource- 
group. Several resource-groups are 
possible choices for an activity 


- A resource-group 

is defined with 

. a set of physical resources 
. a time window 
. a duration 

. temporal constraints 

- Physical resources 

are to be sharable or unsharable, 
consummable (memory) or not 
(electrical power, camera). 

- Temporal constraints 

are absolute (beginning and ending 
times of an activity are bound to 
stay within a given interval) or 
relative (between two activities). 
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Therefore the goal is to find for 
each activity 

. a resource-group 

. an exact temporal position 

This approach is incremental 
in that an activity enters one after 
another one from the set of the all 
activities in a grQwing context. The 
current context is a view of already 
assigned activities but it is 
possible to put this assignment into 
question. The philosophy is the 
following: 

Let A be an activity to be entered in 
. the context 

- If the current context has 
enough room for A, one of the 
possible resource-groups is assi- 
gned to A. 

- Otherwise, the mimimal sets 
of activities that prevent A from 
being assigned one resource-group 
are defined. Then a minimal set of 
activities is chosen, ejected from 
the current context assigning a 
group-resource to A, and has to be 
re-planned. 

- If one of the ejected activities 
cannot be re-entered into the 
context, another minimal set is 
chosen: there is a failure 

- If all the minimal sets fail, it 
is the total failure 

- If all the ejected activities 
are to be re-planned, the process 
succeeds 


It has been proved that the 
general assignment algorithm has 
the following properties : 

- It terminates. 

- It is complete: if a solution 
exits, it finds it. 

Theoretical and pratical 
studies about the average computa- 
tional complexity of the algorithm 
have shown that except for few very 
constrained cases, the average 
number of activities that have to be 
re-planned doesn't depend on the 
number of activities but only 
depends on the saturation rate of 
the context (rate activities 
/possible resources). 

Specific and general heuristics 
are used for choosing: 

A group-resource in the 

context 

- A minimal set of activities 

OSCAR has been successfully 
tested on camera resource 
assignment problem concerning an 
Earth-Obsevation Satellite. 


4 The neural network 
approach 

We are interested here in solving 
a complex optimization problem in 
parallel without learning process. 
About solving constraint satisfac- 
tion problems [10] gives three 
neural networks models : 
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- The Hopfield network [1]. 

- The Boltzmann machine [4]. 

- The Tank and Hopfield network 
[3]. 

Our goal is not here to compare 
the three models applied to a 
specific problem {we find compari- 
sons of models through the 
travelling salesman and the graph 
bisection problems in [5,7]) but we 
want to show how they efficiently 
can help to solve an assignment 
problem, what are their weakness 
and strength compared with the 
.previous approach. 

We use both Hopfield networks 
and Boltzmann machines during our 
simulations. 

These models consist of a large 
number of computing elements 
called units that are connected to 
each other by bidirectional links and 
this massive interconnection gives 
tnem an important computational 
power. 

With each unit Uj a binary 
value is associated, denoting its 
state "0" or "1," (on or off). 
Therefore, at a given time the 
network can be represented by a 
state vector. Weights on links are 
symetric, (having the same strength 
in both directions). A solution is 
given by a configuration C of the 
network that is the state vector. 

An "objective" function of a global 
configuration is defined by analogy 
with statistical mechanics energy 

E = -1/2 wjj sjsj - SjliSj 


where 

wjj is the strength of connec- 
tions between units uj and uj, 

sj is the state of unit i, 

lj is the threshold of unit i. 

If the units change their 
states one at a time (0 — > 1), 
given a configuration C, then firstly 
a neighbouring configuration C' is 
generated, changing unit uj state 
and secondly it is evaluated. 

Because the connections are 
symetric, the difference between 
the energy of configuration C and C' 
can be determined locally by the 
unit uj and 

AEj = Esi=0 ■ Esi=l = ^k w ki s k + lj 
thus allowing a parallel execution. 

In an Hopfield model the rule 
decision is : 

Sj = 0 if AEj < I; 

1 otherwise 

In the Boltzmann machine, the 
units are in one of the two states 
determined as a probabilistic 
function of the states of its 
neighboring units (these which are 
connected to) and the weights on its 
links to them. The acceptance 
probability in changing a unit state 
i s 

p(sj = 1) = 1 / (1 + exp(-AEj/T)) 
where 
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T is the computational tempe- 
rature used in simulations as a 
control parameter associated with a 
simulated annealing process which 
is a statistical generalization of 
hill-climbig optimization methods. 
It allows to make uphill moves 
instead of settling in local mini- 
mum. 

T-0 is the limit-case used in the 
Hopfield model. 

The dynamics of evolution of 
these systems states follow a 
•simple rule (above) and is asynchro- 
nous (a unit is randomly chosen and 
tries to change its state given its 
inputs). 

The updating rule of a unit state 
is an energy optimizing rule 
(minimizing / maximizing ). 
Modifications of units states conti- 
nue until a stable state is reached, 
that is, an energy optimum is 
reached. 


Mapping a satisfaction 
constraints problem 

For mapping a satisfaction 
constraint problem we have to: 

- Find a representation of 
the problem as to be solved by a 
neural network. 

Indeed, the litterature often involve 
schemes which are operation re- 
search ones (matrix, graphs) and we 
have to investigate if it is relevant 
to relate operation research repre- 
sentation problems to neural tech- 
niques. 


The solution to the assignment 
problem consists of an optimal 
assignment with the respect to the 
interacting constraints. 

To map this problem onto the 
computational network, we require a 
representation that needs to be 
decoded. We have chosen a repre- 
sentation scheme in which the final 
assignment is specified by a confi- 
guration of the network. 

For example, if an activity Ai 
requires ri = 3 processings and if a 
possible set of resources for Ai is 

Qi = (01(1 10) 02(3 13) 03(0 9) 011(10 18)} 
a possible solution is given by 


•ooo«oooooo« 

ri r2 r3 ri r2 r3 ri r2 r3 ri r2 r3 


Ol 02 03 Ol 1 

- The processing ri of Ai is on the 
orbit 01(1 10) 

- The processing r2 of Ai is on the 
orbit 02(3 13) 

- The processing r3 of Ai is on the 
orbit 011(10 18) 


- Define units. Therefore a 
unit is the elementary information 
to process in this optimization 
problem and it means : 

" a possible choice " for assigning 
the activity Aj to the resource Oj 
respecting its temporal constraints. 
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This representation scheme is 
natural since any activity can be 
assigned to any one in its related 
possible set of resources. 

The number of units required for 
a problem where p activities are 
involved is therefore 

N = Ep np units 

where 

n p 

(the number of processings of 
activity p) 

* 

(the number of possible orbits 
intervals which 
can be assigned to activity p) 

that is the number of units for 
representing the activity Ap. 

Our point is that resources are 
unsharable that is 

- any part of any orbit cannot be 
simultaneously shared between two 
activities. If Aj' is another activity 
and Qi' its possible set of resources 
and rj'=2 

Qi-= {01(1 10) 05(5 14) 09(7 16)} 

we cannot find the following solu- 
tion scheme 



that is we cannot find rl on orbit Ol 
for activity Aj and r2 on orbit 01 for 
activity Aj*. 

- different processings of the 
same activity cannot share the same 
part of an orbit. So we cannot find 
the following solution scheme 



- the same processing cannot be 
assigned more than one resource at 
a time. So we cannot find 
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that is rl cannot be assigned to 
orbits 01 and 02 


- an activity try to assign all 
the processing it requires: 

• 000 * 000000 • 

rl r2 r3 rl r2 r3 rl r2 r3 rl r2 r3 


01 02 03 Oil 

The "objective" is to occupe as 
better as possible the all set of 
resources. 

Because of these choices a unit ujjk 
means the possibility for activity i 
to assign processing j on orbit k 

Define the connections 

that is define what a link is with 
the respect to the constraints and 
the "objective" of the problem. 

Weights on links represent a weak 
pairwise constraint between two 
hypotheses. 

i : index giving the orbits 
j : index giving the realizations 
t : index giving the tasks 

Connections are built between links 
satisfying the following constraints 

Inhibitory links 

.Two processing of the same 
task do not share a part of the same 
orbit. 


.Two processing of different 
tasks do not share a part of any 
orbit. 

. A task Ti can’t plan more than 
ri processing 


Excitatory links 

. Each unit activates a 
processing of another orbit 


- Define what are the right 
connection weights 

For computing a solution to the 
problem, the network has to be 
described by an energy function in 
which the most stable state of the 
network is the best assignment. Our 
energy function is the following 

E = -a^i.i'e c 1 ( r i*(pi + Pi’)) s i s i’ 

-bZi ,i’ € C 2(max(pi,pi0)sisi’ 
-c2i,i’ec3(min(pi+pi'))sisi' 
+dXu’ G c4(ri*(pi+Pi'))siSi’ 

where 

c1={uj,uj'/ activityj ■ activity!' 
orbitj = orbitj' 
processingj*processingj'} 

c2 = {uj,ui’/ activity,- = activity!' 
orbitj * orbitj' 
processingj= processing!'} 
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c3 ={ u j, u j-/ activity) * activity j* 
orbitj - orbit) • 
(processing [^processing)*) 
or 

(processingj-processingj*)} 

c4=.{uj,uj*/ activity) - activity) • 
orbit) « orbitj* 
processing)=*((processing)'+1 ) 
mod (number of proceesingj))} 

a,b,c,d > 0 are parameters 

Pi „ F(number of possible resources 
for A), number of activities 
for which orbit related to uj 
is a possible resource, 
number of processings 
needed by Aj) 

This function gives advantage to the 

less requested resources. 


5 Starting a discussion 
- Complexity 

Complexity is defined in com- 
puter science by : 

- Spatial complexity 

- Temporal complexity 

The neural network simulations 
always converged giving satisfying 
solutions from an engineering point 
of view for little examples with 
256 units (25 activities and 21 
resources) or less. 

If the complexity has been 
theoretically and pratically studied 


in the R.O. and I.A. approach giving 
very interesting results about the 
average computational complexity 
of the algorithm, for very constrai- 
ned cases, combinatorial problems 
are again involved. 

Theoretical studies are being 
made for the neural net one. 
Nevertheless, in this application the 
neural network appears to converge 
with the number of units. 

If many activities are involved 
in a problem, a great number of 
possibilities appears. Therefore, 
solving such a complex optimization 
problem needs a large number of 
units and a highly connected 
network. But because of the 10 11 
neurons and 10 6 connections from 
each one in the nervous system and 
very encouraging results which 
appear in the domain, 'it is relevant 
to investigate how the computatio- 
nal power of these networks can 
help to solve optimization problems. 

Morever, neural networks are 
parallel systems which are func- 
tionnally implementable . 

- Locality of taking 
decisions 

The assignment algorithm de- 
cides with locality. Indeed, when a 
new task enters, only its possibility 
of assignment is investigated. 

The new task is is not able to be 
planned. No global criteria is taken 
into account. An already planned 
task is ejected only if it is sure to 
get another assignment. 
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A neural net approach also 
decides locally about an assignment. 
Indeed the model is based on 
computational locality of decision 
in the units. Morever, it takes 
immediatly into account the 
constraints on other units that is 
the constraints of the problem. 
Therefore, there is a "microscopic" 
decision system (cooperation 
/competition) in every unit because 
of the neighbourood. (defined by the 
connections.) 


- Global / incremental 
decisions 

The set of constraints mapped on 
the connections to a unit makes the 
unit to take locally a global decision 
that is it computes a global criteria 
to optimize. 

We give for example in [8] a 
criteria to maximize "the probabi- 
lity of satisfying all the activities'. 
Therefore an already planned task is 
ejected if the new activity opti- 
mizes the "objective" function 
satisfying the constraints given by 
the neighbours (the units which it is 
directly connected to). 

In comparison, the research 
operation and artificial intelligence 
approach is an incremental decision 
process in which no global criteria 
is computed. 

If the objective is to use all the 
ressources realizing the best 
assignment we find the following 
results for each approach: 


Example 


Activities 

T~ 

2 

3 

4 

number of 
processings 

2 

2 

2 

2 

lattitude of 
begin 

1 

1 

1 

1 

lattitude of 
end 

~ 6 ~ 

6 

6 

6 

list of orbits 

ol 

o3 

o3 

o4 


o2 

o4 

06 

o5 


o3 


o 1 



In this example the R.O. and I.A. 
approach can only cope with two 
activities: 

-T1 enters and is satisfied 
with T1 on orbits Ol and 02 
or 

T1 on orbits 01 and 03 
or 

T1 on orbits 02 and 03. 

-T2 enters and is satisfied 
with T2 on orbits 03 and 04, 
and T1 on orbits 01 and 02. 

-T3 cannot be satisfied 
without definitively ejecting 
T1 or T2 

-T4 cannot be satisfied 
without ejecting T2 

In that case, our network satisfied 
T1, T3 and T4, i.e. three tasks: 

-T1 on orbits 01 and 02 
or 

Tlon orbits 01 and 03 
or 

T1 on orbits 02 and 03 
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-T3 on orbits 01 and 06 
and T1 on orbits 02 and 03 
or 

T3 on orbits 03 and 06 
and T1 on orbits 01 and 02. 

-T4 on orbits 04 and 05 
and T3 on orbits 01 and 06 
and T1 on orbits 02 and 03 
o r 

T4 on orbits 04 and 05 
and T3 on orbits 03 and 06 
and T1 on orbits 02 and 03. 


- Programming complexity 

In the neural network formula- 
tion of an optimization problem, the 
constraints and the criteria to 
optimize are expressed inside the 
objective function. Thus by optimi- 
zing the objective function we 
optimize the satisfaction of the 
constraints. Morever, this approach 
provides an efficient and very 
simple technique for mapping the 
constraints on the links between 
units. 

In the R.O. and I.A. approach, 
constraints on resources and acti- 
vities are these which tend to 
reduce the combinatoric aspect and 
that is why the constraint-base 
reasoning is a more complex propa- 
gation mecanism. 


6 Conclusion 

We have described here how an 
optimization problem can be rapidly 
and easily mapped on a neural 


network and provide encouraging 
results in comparison with an 
operation research and intelligence 
artificial approach. 

Nevertheless for neural net- 
works which deal with such complex 
combinatorial optimization pro- 
blems, the difficult task consists of 
finding weights of the connections. 
Indeed, because the solutions to 
these problems are not known as in 
other problems involving learning 
algorithms [6], they must be esta- 
blished by the designer. 

Our interest is now to design a 
mapping method for solving 
constraint satisfaction problems 
(more precisely scheduling pro- 
blems) through applications explo- 
ration and theoretical results. 
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